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Abstract 

This paper studies the second moment boundedness of solutions of hnear 
stochastic delay differential equations. First, we give a framework, for gen- 
eral N-dimensional linear stochastic differential equations with a single dis- 
crete delay, of calculating the characteristic function for the second moment 
boundedness. Next, we apply the proposed framework to a special case of 
a type of 2-dimensional equation that the stochastic terms are decoupled. 
For the 2-dimensional equation, we obtain the characteristic function explic- 
itly given by equation coefficients, the characteristic function gives sufficient 
conditions for the second moment to be bounded or unbounded. 
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1. Introduction 

Stochastic delay differential equations have been extensively studied in 



ensiveiy 

the last several decades from different points of view (see js], 0, @- 13|, [iSl, [16 
and the references therein). However, many basic issues remain unsolved 
even for linear equations with constant coefficients. 



^Supported by the Natural Science Foundation of China (NSFC 11031002), the Funda- 
mental Research Funds for the Central Universities and the Scientific Research Foundation 
for the Returned Overseas Chinese Scholars, State Education Ministry. 

^Supported by the Natural Science Foundation of China (NSFC 11272169). 



Preprint submitted to Stochastic Processes and their Applications 



October 11, 2012 



In this paper, we study general A^-dimensional linear stochastic delay 
differential equations with a single discrete delay (here we assume the delay 
r = l) 



dWk. 



dxiit) = a{xj{t) + bixj{t - 1) dt+ + a{''xj{t) + r/f Xj(t - 1 
(i,i = l,--- ,iV; k = l,---,K) 

(1.1) 

Here the Einstein summation convention has been used so that repeated 
indices are imphcitly summed over, all coefficients a], 6], /if, aj^, rij^ are 
constants, and Wk are independent 1-dimensional Wiener Processes. The 
initial functions are assumed to be Xi = (pi E C([— 1,0],M) (i = 1, ■ ■ ■ ,N). 
This paper considers the second moment boundedness of solutions of fll.ip . 
We always assume Ito interpretation for the stochastic integral, and results 
for Stratonovich interpretation can be obtained similarly. 

To the best of our knowledge, there are very few results for the stability 
and second moment boundedness for equation (11. II) . and most of known 
results are obtained through the method of Lyapunov functional 



However, it remains unclear how can we define the characteristic equation 
for the boundedness of the solution moments of (II. ip . In 2007, Lei and 
Mackey [[8|] introduced the method of Laplace transform to study the second 
moment boundedness of 1-dimensional equations with a single discrete delay. 



and proposed a characteristic equation. In [17|, the authors extended the 



method to the 1-dimensional equation with distributed delay. 



Based on previous studies [8|, |17[ , this paper aims at proposing a general 
framework to calculate the characteristic function for high dimensional lin- 
ear stochastic delay differential equations with a single delay. The obtained 
characteristic function (as we can see below) is complicate, that shows the 
elaborate correlations when delay and stochastic effects are coupled into an 
dynamical system. As an example, we apply the framework to study a spe- 
cial situation of a 2-dimensional equation in which the stochastic terms are 
decoupled {N = K = 2, and /if = aj^ = jf-^ = when i ^ k). 

Rest of this paper is organized as follows. In Section 2, we briefly in- 
troduce basic results for linear delay differential equations. In Section 3, a 
general framework for defining the characteristic function of a N-dimensional 
stochastic delay differential equation is given. In Section 4, we discuss the 
boundedness of the second moment of (11.11) for a simple case: N = K = 2 and 
the stochastic terms are decoupled. Theorem 14.11 establishes the unbounded 
condition for the second moment if the trivial solution of the unperturbed 



2 



equation is unstable. When the trivial solution of the unperturbed equation 
is stable, we obtain a characteristic function given explicitly by the equation 
parameters. Boundedness of the second moments depends on the supremum 
of the real parts of all roots of the characteristic equation (Theorem 14. 3p . An 
explicit condition for the boundedness of the second moment is also proved 
following framework of calculation given here (Theorem 14. 7p . 



2. Preliminaries 

In this paper, we always use the norm for a tensor. For example, the 
norm of a second order tensor A = {al} is 

N 

= Yl (2-1) 
For = (0i)Arxi £ C([~l) 0], M^), the norm is defined as 

N 

11011= sup Y.\^m\- (2.2) 

In this section we give some basic results for the iV- dimensional linear 
delay differential equation 

-^ = aix,{t) + ^x,{t-l) (z,j = l,---,iV) (2.3) 

with initial functions Xi = (pi G C([— 1,0],M). The linear autonomous func- 
tional differential equation (12. 3 p has been studied extensively and details can 
be referred to [ll,!!,]^. 

The fundamental matrix of (12. 3p . denoted by 



X{t) = (X/(t)) 



NxN ' 



is the solution of (12. 3p with the initial condition (hereinafter 5 means the 
Kronecker delta) 

' 6i, t = 0, 
0, -l<t<0. 
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Using the fundamental matrix X{t), the solution of fl2.3p with initial function 

G C([— 1,0],M^) can be represented as 

x^,iit) = (t)0,(o) + J (t - 1 - e)h]<pi{e)de. (2.4) 

From fl2.4p . the asymptotic behavior of x^{t) = {x^^i(t)) ^^-^ is determined by 
the fundamental matrix X{t). 
Denote the matrices 

A = {al)NxN, B = {bl)NxN, I={61)nxn, jJ' = (iJ'Dnxn- (2.5) 

Taking the Laplace transform on both sides of 02.31) . we obtain 

£(X)(A) = [A{X)]-\ (2.6) 

where 

A{X) = XI ~ A- Be-^. (2.7) 

Thus, h{X) = det(A(A)) is the characteristic function for the linear stability 
of (12731). 

The following results are straightforward from the above discussions. 
Theorem 2.1. Let 

ao = sup{Re(A) : h{X) = 0, A G C}. (2.8) 

Then 

(i) for any a > ao there exists a constant K = K{a) > 1 such that the 
fundamental matrix X{t) satisfies 

\\X(t)\\<Ke''\ t>0; 



(ii) for any a > ao there exists a constant K = K{a) > 1 such that for 
any (f) G C([— 1, 0], M^) the solution x^{t) of l{2.3\) satisfies 

||x^(t)|| <K||0||e°*, t>0; 

(iii) for any ai < ao, there exists a G {ai,ao) and a subset U C M+ with 
measure m{U) = +oo such that for any i, j = 1, ■ ■ ■ , N , 

||X/(t)|| > e"*, teU. (2.9) 
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Here, the number is also termed as the Lyapunov exponent (Definition 
1.19 in [l|). The proofs of (i) and (ii) in Theorem 12. II is referred to the proofs 
in [l], Theorem 1.21 in Chapter 3]. The proof of (iii) is similar to that of (itI . 
Theorem 2.3, 2] and is detailed at Appendix A. 

From Theorem 12. H the trivial solution of (12. 3p is locally asymptotically 
stable if and only if < 0. 



3. Moments of linear stochastic delay differential equations— General 
cases 

Now, we discuss the solution moments and a framework for calculating 
the characteristic function of the second moment of solutions for general 
cases. 

The existence and uniqueness results for stochastic delay differential equa- 
tions have been established in [g], [ii|, 14 |. Using the fundamental matrix 
X{t), the solution of (11. ip with initial function x = (j) E C([— 1, 0], M^) is a 
A^-dimensional stochastic process given by Ito integral as follows 

Xi{t;(f)) =x^,i{t)+ [ Xl{t-s){^'l + ai^Xj{s;(f))+r]j''xj{s-l;(f)))dWk, t > 0, 
Jo 

(3.1) 

where {xip^i{t))Nxi is the solution of (12. 3p defined by (12. 4p . 

We denote by E the mathematical expectation. Now we give the defini- 
tions of the p^^ moment exponential stability and the p*^ moment bounded- 
ness. 



Definition 3.1. A solution x{t;(j)) of (ll.ip is said to be the first moment 
exponentially stable if there exist two positive constants 7 and R such that 

\\Eix{t;m<RMe-^\ t>0, 

for all G C((— 1, 0], M^). When p >2, a solution of (II. ip is said to be the 
p^^ moment exponentially stable if there exist two positive constants 7 and R 
such that 

E{\\x{t;<P) ~ E{x{t;m') < RHre-^\ ^ > 0, 
for a//0 G C((-1,0],R^). 
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Definition 3.2. For p > 2, a solution x{t;(j)) of fll.ip is said to be the p^^ 
moment bounded if there exists a positive constant C = C*(||0||^) such that 

E{\\x{t-(P)-E{x,{t-A))r) <C, t>0, 

for all G C((— 1, 0], M^). Otherwise, the p^^ moment is said to be un- 
bounded. 

3.1. First moment 

From (13. ip and applying the properties of Ito integral, it is easy to have 

Exi{t-(t)) = x^^i{t) {i = l,--- ,N). 

Thus, the following result is straightforward from Theorem I2.1[ 

Theorem 3.3. Let be defined by (12. 8p . For any a > a^, there ex- 
ists a positive constant K ( defined as Theorem \2.1\) such that for any cf) G 
C([— 1, 0], M^), the solution x{t;(j)) = {xiit; (f)))Nxi of (II. ip satisfies 

\\Exit;<P)\\<K\me'^\ t>0. (3.2) 

In particular, the first moment of (II. ip is exponentially stable when ao < 0. 

3.2. Second moment 

Now we study the second moment. First, we give some notations. Let 
x{t](f)) = {xi(t))Nxi be a solution of (ll.ip and Xi{t) = Xiit) — E{xi{t)) {i = 
1, ■ ■ ■ ,N), and define 

Mi,{t) = E{S:i{t)xj{t)), Nij{t) = E{S:,{t)xj{t - 1)). (3.3) 

Then Mii{t) is the second moment of Xi{t). It is easy to have Xi{t) = Mij{t) = 
Nij{t) = when t G [-1, 0], and E{xi{t)) = for all t > 0. 
Denote 

Sf(.)=/if + afx,(.)+r^fx,(.-l). (3.4) 
From (13. ip . we have 

x,{t)= [ xl{t-s)j:'i{s)dWk. 

Jo 

Since E{dWkdWm) = 5fc,m, we obtain 
M,,(t) = E{x,{t)x^{t)) = f X\{t-s)E [Sf(s)5,,„S7(s)] X^^{t-s)ds. (3.5) 

^0 
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3.2.1. Additive noise 

We have additive noise when cr/*^ = r^/^ = for any i,j,k and yU 7^ (/i is 
defined at fl2.5p ). In this case, we have 



M,,(t) = / X,'(s)Xj(s)/if5fc,„/i^rfs. (3.6) 
Jo 

Thus the upper bound of M{t) is determined by that of the fundamental 
matrix X{t). Hence, we have the following sufficient conditions for the second 
moments M{t) to be bounded or unbounded. 

Theorem 3.4. Let ao he defined as (12.81) . Assume aj'' = rjj'' = for any 
i,j,k and /i 7^ 0. Then the second moment of f 1 1.1 1) is bounded if ao < 0, 
and unbounded if ao> 0. 



The proof is similar to that in 17!, Theorem 3.4] and is omitted here. 
The critical case ao = is not discussed here and the boundedness issue 
remains open. 

3.2.2. A general framework 

Now, we consider the general situation. Let 

Pi,{s) = E(Sf(s))5fc,^E(S^(s)), 

Qi,{s) = E[(a/%(s) + r//%(s-l))4,r«(<'5,(s)+r7^"^£,(s-l))\ 
Then Pip{s) = Ppi{s), Qip{s) = Qpi{s) and 

+ [cri'Sl^rr^Vr + vf^Km^r) ^^.i^)' (3-7) 

We note that Xj(s) = Xj(s) + Exi{s), then 

E [Sf (s)(5fc,„E;^(s)] = Pip{s) + Qip{s). 

Therefore, 

M,,(t) = f'xlit - s)X^{t - s){Pip{s) + Qip{s))ds. 
Jo 



7 



Denote ^ 

F,,{t)= I Xl{t-s)X^{t-s)Pip{s)ds, (3.8) 
Jo 

then ^ 

M,,(t) = F,^{t) + I X\{t - s)X^^{t - s)Qip{s)ds. (3.9) 
Jo 

Similarly, we have 

.t-i 

N^,{t) = / Xl{t - s)Xj(t - 1 - s){Pipis) + Qipis))ds. (3.10) 
Jo 

From ([33]), we have \Mii{t)\ > \Fii{t)\ (Vi). If ao > (ao is defined by 
(12.81) ). similar to discussions in [13], \Fii{t)\ approaches to infinity exponen- 
tially, and therefore the second moment is unbounded (a proof for the case 
of a 2-dimensional equation is given in the next section). Thus, we only need 
to study the situation when ao < 0. 

From (13.91) and (I3.10p . and take Laplacians to both sides of them (exis- 
tence of the Laplacians are proved in Lemmas 13.51 and 13.61 below) . we obtain 

C{M,,) = £(Xfx;) [£(P,,) + £(Q,,)] , (3.11) 

and 

£(iV,,) = £(Xf (t)X;(t - 1)) [CiPhp) + CiQhp)] . (3.12) 
From (13.71) . we have 

+ K%,mVr + vtS,,^crjr)^N,,). (3.13) 

Now, one can solve C{Mij) from (I3.1ip - (I3.13I) following the procedure 
below. First, solve C{Php) + C{Qhp) by C{Mij) from (13.111) as 

C{P,,) + C{Q,,) = SgC{M,,). 

Here S'^^ is the inverse tensor of C{X^Xj). Next, substitute the obtained 
^{Php) + ^{Qhp) into (13.121) to linearly express C{Nij) through C{Mij): 
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Then, put the resulting C{Nij) into fl3.13l) so that C{Qhp) hnearly depends 
on C{Mij) in the form 

C{Q,,)=Tl:lC{M,i). 

Finally, substituting C{Qhp) back to (13.111) to obtain an equation for C{Mij) 
of form 

{6f^ - C{X^X^^)Ttl) C{Mu) = C{X^Xl)C{P,i), (3.14) 

Then equation (13.141) is a linear equation of C{Mki). Thus, the determinant 
of the coefficients, denoted by 

Hi\) = det [(5g - CiX^X^)T^l)] , (3.15) 

is the desired characteristic function. 

We note that (I3.14p contains A^^ linear equations. Nevertheless, we can 
simplify the calculation due to symmetry. For example, since C{Mki) = 
C{Mik) and C{Pki) = C{Pik) in (I3.14p . we only need to solve equations for 
C{Mki) with k < I, and therefore have A^(A^ + l)/2 equations. 

The above procedure gives a general framework to obtain the character- 
istic function. However, it is too complicate to obtain an explicit expression 
for general cases. In the next section, we study a 2-dimensional equation 
with a specific form. 

Denote the matrices 

M = (Mf(t))^xiv, N={N',{t))M.N, F={F^{t))M>,N, Q = {Qm)NxN. 

Before introducing the results for the 2-dimensional equation, we give some 
estimates for F{t), M{t) and N{t) for general situation. These estimations 
ensure the existence of Laplace transforms of F{t), M{t) and N{t). 

Lemma 3.5. Let be defined at (12.81) and assume Oq < 0. Then for any 
a G (ao;0), there exists a positive constant Ki = Ki{a,(l)) (0 G C([— 1, 0], M^)) 
such that 

||F(t)|| <iri(l-e2°*), t>0. (3.16) 

Proof. From Theorem 13. 3^ for any a G {ao,0), there exists a positive con- 
stant K = K{a) such that 

Ei^Ks)) < l|/il|+A^X^(|af|+e-1r/f|)||0||e"^ 

i=i 

< ||/i||+ir(||a||+e-"||r^||)||0||e- 
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for any k, I. Here || ■ || , as we mentioned before, mean the norm of a tensor. 
Hence, 

\Pipis)\ < (M+k{\\a\\+e-^\\v\ 



From Theorem 12. 1^ there exists a positive constant K = K{a) such that 
||X(t)|| < Ke°'^. Therefore, from (13. Sp . it is not difficuh to have a constant 
Ki (defined by K and K) so that (13.161) holds. 

Lemma 3.6. Let ao be defined at (12.81) and assume ao < 0. For any a G 
{ao,0), there exists v = z/(a) such that 



\\Mit)\\<K,e 



ut 



t > 0, 



and 



\\Nm < {l + e-^)K,e 
where Ki is defined as in Lemma \3. 51 



vt 



t > 0, 



Proof. From the Cauchy-Schwarz inequahty, we obtain for i,j = 1, 

Miiit) + Mjj{t - 1) 



\Nij{t)\ = \E{£i{t)S:j{t-l)) \ < 



Then 



Hence, from (13. 7p and (I3.20p . there exists Cq > so that 

\Qip{s)\ < a/%„a7M,,(s) + r7f4,„cr^'"M,,(s - i: 



+ 



< Co(||M(.)|| + ||A^(s-l) 



(3.17) 
(3.18) 



(3.19) 



1 ^ 

l|iV(t)l| <-J2 (Muit) + M,,{t - 1)) < ||M(t)l| + \\M{t -1)1 (3.20) 



(3.21) 
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Thus, from Lemma [3. 5 [ we obtain for any a G (ao, 0), 

mm < iiF(t)ii+ f\\x{t~s)r\\Q{s)\\ds 

Jo 

'0 



< Ki + CoK2(l + e-2") /" \\M{s)\\ds. 

Jo 



\\Mis)\\ds 



Applying the Gronwall inequahty, we have 

l|M(t)|| <i^ie^*, 

where u = Co^^(l + e~^"). The estimation (I3.18P is obtained from (13.171) 
and dS^ni). 

4. Application to 2-dimensional equations 

In this section, we apply the general framework established in the above 
to a special case of a 2-dimensional equation that N = K = 2 and /if = 
crj^ = rjj^ = when i ^ k. Hereafter, we do not use the Einstein summation 
convention, and introduce following notations for simplicity: fii = fi^, aj = 
erf, ril = r]l\i,j = 1,2). Thus, the equation we studied becomes 



dxi(t) = (^a{xj(t) + b{xj{t — 1)) dt 



dx2{t) = (a^Xj(t) + — 1)) (it 



(4.1) 
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In this particular case, the expressions of Pijit), Qijit) and Fij(t), Mij(t), 
Nij{t) = 1,2) in the previous section are as follows: 

Pl2it) = P2lit) = Quit)=Q2lit)=0, 

Piiit) = (^^^ + Y^y,Ex,{t)+4Ex,{t-l))^ >0, 
Quit) = E(^yrx^{t)^r^li,{t-l))^ >0, 



and 



2 M. 

Fijit) = y, X^{t-s)X^{t-s)Pkk{s)ds, 

2 i-t 

M^At) = X^{t-s)X^{t-s){Pku{s) + Qkk{s))ds, 

k=l 

2 .t-1 

Ni^t) = V/ X^{t-s)X^{t-l-s){Puk{s) + Qkk{s))ds. 
k=i 



Before we state and prove the main results, we introduce some prelimi- 
naries below. 

When iV = 2, we consider the delay differential equation 



dxi 
~dt 

dx2 
"dt 



J](aix,(t) + 6ix,(t-l)) 



2 



(4.2) 



y^{4x,{t) + }}>^x,{t-l)) 



The characteristic function of ( 14. 2 p is given by 

X-a\- h\e'^ -a\ - bje-^ 
-al - h\e'^ \- al- bje^^ 



h{X) = det(A(A)) = det 

= \^ + a\ + b+ {c\ + d)e~^ + re~'^^ 



(4.3) 



where 



a = —al — a^, b = a^a^ — a\a\, c = —b\ — b: 



21 
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d = albl + Og&i — albl — albl, r = b\b\ — b\bl. 
The Laplace transform of the fundamental matrix is 

C(X)(X) ^ A-(A) ^ ( ^ - "I - 5f ' , 1] ) , (4.4) 

Here we give some properties of the fundamental solution X{t) that are 
useful for the estimate of the second moment below. 
Recall 

ao = sup{Re(A) : h{\) = 0, A G C}. (4.5) 
When cto < 0, from ( 14. 4p . we have 



1 rii 1 /'+CXD 

Xit) = lim / e^'A-\X)dX = — e''^'A-\iio)duj. 

Thus, from (14. 4p . we obtain 

..u ^ 1 [+°° luj-al-ble-'^ . , , 

= ± / ^llh^e'^^'du, 



271 J _^ h{tio) 
X2^(t) = — -3—-^ e*'^*rfw. 



2vr H^^) 

Obviously, (t)Xj'(t) and 1) k = 1,2) have Laplace trans- 

forms. When ao < 0, explicit expressions and estimates for the Laplace 
transforms C [Xi{t)Xj{t)), C [X!^{t)Xj{t - 1)) are given in Appendix B. 

4.I. Unboundedness of the second moment 

Here we give a result for the unboundedness of the second moment of 
(14.11) when oq > 0. First, we note a rare situation when the coefficients 
fj,i,al,ril = 1,2) satisfy the following assumption. 
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Assumption H: /ii = /i2 = 

h{X) = and an eigenvector c 
eigenvalue A such that 




2 



J2{al+e-^i]i)cj = 0, 1 = 1,2. 



When the assumption H is satisfied, the stochastic equation (14. ip has a 
deterministic solution x{t) = e^^c {t > 0) with initial function (p = e^*c (— 1 < 
t < 0), and the corresponding second moment M{t) = 0. This is a very rare 
situation and is excluded in discussions below. 

The following result shows that in general the second moment of (14. ip is 
unbounded when the trivial solution of (12. 3 P is unstable. 

Theorem 4.1. Let ao be defined as (14. 5 p and ao > 0. // the assumption H 
is not satisfied, the second moment of (14. ip is unbounded. 

Proof. We only need to show that there is a special solution x(t; cj)) of 
(14. ip such that the corresponding second moment is unbounded. Note that 
Pii^ Qii > (z = 1, 2), and hence 



Let A be a solution of h{X) = with < Re(A) < ao, and c G the 
corresponding eigenvector. Then x^p-^it) = Re(e^*c) is the solution of (14. 2 p 
with initial function (pi = Re(e^*c) (— 1 < t < 0). Since the assumption H is 
not satisfied, x^^^it) is not a solution of (14. ip . Following the proof of Theorem 
12.11 (3), there is a subset U C with m(f/) = +oo and positive constants 
Ci, C2 such that for any t ^ U, 



\\Mit)\\ > Mn(t)>Fn(t) 




(4.6) 



Xi{t)\ > e'^\ a G (0,ao), i 



1,2 



and 



Pn{t)>Ci or P22it)>C,. 



Thus, from (14. 6p . the second moment M{t) is unbounded. 



□ 
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4-2. Boundedness of the second moments 

Now, we always assume < 0- Then fl3.11l) - fl3.13l) become 

2 

£(M,,) = Y,C{X^X^){C{Puk) + C{Qkk)). (4.7) 

k=l 
2 

^(^^.) = J]/:(Xf(t)X^(t-l))(£(Pfc,) + £(Q,fc)), (4.8) 



fc=i 

and 



fc=l k,l=l 

+ 2{ala^ + 7^lr,^e-^)C{M,,). (4.9) 
Proposition 4.2. Define the matrices 

with 

Gl{\) = Kf + Kfe'' + Y.TlSl (A:,g = l,2), (4.11) 

p=i 

Tl = 2{alal + r^^r^^e-^)£(XfXf ) + 2 ^ ^Nu^Ximfit - 1)) (4.12) 

and S = (5^^)2x2 = ^W^^ for Re(A) > oa, where 

ua = sup {Re(A) : det(A(A)) = 0, A G C} . 

Then 

2 

£(Mi2) = E /:(XW)5^/:(M,,) (4.13) 

k,i=l 

and 

w;/iereD(A) = A(A)G'(A). 
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Proof. Assume Re(A) > and therefore S = A{X) ^ is well defined. From 
( 14. 7p . we have 

2 

£(M,,) = J2^ii^'y)i^iPkk) + C{Qkk)), ^ = 1,2, 



k=l 



therefore 



CiPkk) + C{Qkk) = J2siC{Mu), k = l,2, 



(4.15) 



i=l 



which gives fl4.13p from (14. 7p . 
From dMl) and (ITOD . 



£(iV,,) = J2 SlC{X!{t)X^^{t - 1))£(M,,). 

p,<7=l 

Thus, from (jH]), f OOjl - flCTj) and f 03|) . we obtain 



9=1 



m,l,p=l 
2 2 

p=l q=l 



ml 



2 r 



9=1 



+2 ^ aTri,C{Xl{t)Xf{t - 1)) 



m,(=l 



/:(M, 



q=l 



(4.16) 



Hence, from (14.70 and (I4.16p . we have 

2 2 2 

£(M,,) = 5^£(Xfxf)£(P,,) + ^£(Xfxf)5^G^,£(M, 

5=1 



ifc=l 



k=\ 



16 



I.e., 

/ /:(Mn) A _ ,,,, / C{Pn) 



which yields (14.141) . and the Proposition is proved. □ 
Denote 

H{\) =detil - D{\)). (4.17) 

From ( Hlij) . 

£(Mn) ^ _ adj(J - ^(A))^^^^ / £(Pn) \ ^ ^^^^g^ 



C{M22) J H{\) ' ' V -^(^^ 



22 J 



where adj(-) denotes the adjoint matrix. 
Let 

ao = sup{Re(A) : h{\) det(A(A)) = 0, A G C}. (4.19) 
Then = maxjao, «a}[21, and A{X) is invertible for Re(A) > oiq. Thus -D(A) 
and ^^^^^ui^^"^^^^^ analytic for Re (A) > ao- 

In the following theorem, we show that H{X) is the characteristic function 
for the second moment boundedness. 

Theorem 4.3. Let H{X) = det(/ — D(A)) and -D(A) be defined as in Propo- 
sition \4^ Let cxq he defined at (14.191) and assume ao < 0. Then 

(i) if all roots of the equation H{X) = have negative real parts, then 
the second moment for any solution of (14.11) is bounded, and M{t) 
approaches a 2 x 2 constant matrix exponentially as t ^ +oo; 

(ii) if the equation H{X) = has a root with positive real part, and the 
assumption H is not satisfied, then there exists a solution of (14. ip whose 
second moment is unbounded. 



To prove Theorem 14. 3[ we first give some useful Lemmas. 



Lemma 4.4. Let D(X) be defined as in Proposition \4 ■ S\ and assume < 0. 



Then there exist constants rfg and Tq such that for |A| > To and Re(A) > Oq, 

P(A)||<^. (4.20) 



^We conjecture that uq ~ ao, but are not able to prove. 
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p 

Proof. From Lemma Appendix B.l there exists Rq so that ||yl(A)|| < -p^ 

when |A| is large enough. Thus, it is enough to show that there exists a 
constant qq such that when Re(A) > a^, 

hmsup|G^(A)| < ^0, VA;,g = l,2, (4.21) 

A|->+oo 

Then (14.201) is satisfied with do = Rogo- 

To prove (I4.2ip . we only need to show that when Re(A) > cxq, 

limsup \S^pC{XfX^)\ < +00, 

limsup \S^^£{Xi{t)Xf{t - 1))| < +00. ^^-"'^ 

|A|->+oo 

Here we only give the proof of the first result of (I4.22p for p = q = 1, and 
the others are similar. 

For any Re(A) > Oq, from Lemma Appendix B.l we obtain 

QifAl = -^((^2)') ^ \-ao-a\- &^e-("-"°) + hjX - ao)^22(A) 
' det(A(A)) det(A(A)) 

where 

det(A(A)) = £((X|)2)(A)£((X2^)^)(A)-/:((Xi^)^)(A)/:((X,i)^)(A) 
= [A - ao - ^2 - ble-^^-""''^ + h{X - «o)^ii(A)] 
X [A - ao - a} - fe^e-^^-"") + /i(A - ao)g22{\)] 

- [al + 6?e-(^-"°) + h{X - ao)gi2W] K + ble~^''"°^ + h{X - ao)^72i(A)] . 

Thus, from flB.7p . when Re(A) > ao, det(74(A)) 7^ and there exists a con- 
stant sii > such that 

I , eiMM r I A (A - ao - a} - fo^e-^^--") + /i(A - ao)^?22(A)) | 
lim A^i A) = hm - — ^ — — t-ttttvi = 

|A|^+ool ^' iAK+00 |det(A(A))| 

Hence, from flB.81) . there exist two positive constants T and Ru = 2su such 
that for |A| > T and Re(A) > ao, 

\X^SlC{XlXl)\<Rn, (4.23) 
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which imphes 

hmsup \SlC{XlX^)\ < +00, 

|A|— >-oo 

and the first inequality in fl4.22l) for p = q = 1 is proved. □ 
From Lemma [4. 4[ when Re(A) > ao, H{X) is analytic and 

hm |f^(A)| = l. 

I A|— >+oo 

Thus there is a real number Pq such that all roots of -f^(A) = satisfy 
Re(A) < (3o (refer to the discussion in j^, Lemma 4.1 in Chapter 1]), where 

(3o = sup{Re(A) : H{X) = 0, A G C}. (4.24) 

Let 

Z{t) = C^' {j^f^m - D{X))m^ , (4.25) 

then from (KIM . 



The following result gives an estimation of Z{t). 

Lemma 4.5. Let /3o be defined at f l4.24p and assume ao < 0. There exists a 
positive constant C3 such that for any (3 > maxjao, /3o}, 



< C^e^K (4.27) 

The proof is similar to that of Theorem 5.2 in Chapter 1] and the details 
are given in Appendix C. 

Lemma 4.6. Assume ao < 0. If Mii{t) , M22{t) are bounded, then Mi2(t) is 
also bounded for any t > 0. 

Proof. Assume that there exists a positive constant Mq so that 

Mii{t) < Mo, Vt > 0, z = 1,2. 

Let 

Y,{t) = £(XW)5^ j , ^ = 1, 2. 
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Then (Km yields 

Mi2(t) = J2 / ^^(^ - s)Muis)ds. (4.28) 

Similar to the proof of f l4.23p . there exist positive constants Rik {i, A; = 1, 2) 
and T* such that for |A| > T* and Re(A) > 

Thus, when < 0, similar to the proof of Lemma 14. 5[ there exist positive 
constants pi{i = 1,2) such that for any a > ao, 

mm < p,e''\ 1 = 1,2. (4.29) 

Hence, from (14.291) . when ao < 0, for any a G (ao, 0), 



|Mi2(t)| < Mojm{s)\ + \Y2is)\)ds<{p^+p2)Mo| e'^'ds 
2(pi + p2)Mo 



< 



a 



i.e., Muit) is bounded. □ 

Now we are ready to prove Theorem 14.31 
Proof of Theorem ^.Sl Let H{X) = det(J — -D(A)) and D(X) be defined as in 
Proposition 14. 2[ and (3o be defined as (I4.24p . We also assume ao < 0. 

From (13. 2p . for any a G (ao,0), there exists a constant K2 = -^^2(0) 
(0 G C([-1,0],M^)) such that 

Pn{t) < {pif + i^se"*, Vt > 0, i = 1, 2. (4.30) 

The prove is straightforward from 

Piiit) = {fii + alExi(t) + rilExiit - 1) + alEx2{t) + rilEx2{t - 1))' 

< + (l^.^l + \\Exm + {\r^l\ + \r^^\) \\Ex{t 

-r2km\^^^\ {\^]\ + k.^l) +2ir||0||e-1/..| (|r^,i| + 
+ 2k'Ure--{\al\ + \aj\){\r^l\ + \r^^\) 



^2 

2 
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(i). Assume /3o < 0. Let 
M{t) = 



M22(t) 



From Lemma for any f3 G (maxjao; 0) , a G (ao? 0) and a ^ (3, from 



\\M\\ < / ||Z(s)||(Pn(t-s) + P22(t-s))t/s 

^0 



Csl/io ^ + 2i^2 



-/3 



gat _ 

a — /3 



< C3(^ + 



From Lemma the second moment M(t) is bounded for any initial function 
</)GC([-1,0],M2). 
Let 



It is easy to have 



Moo,2 



+ 00 



Z{S) 



ds. 



\\M^\\ < /io / \\Z{s)\\ds < Ca/^o / ^ e^'ds = 











Thus, from (Km 

M{t) - M, 



Z{s) 



Pii{t~s) - ifiif 



P22{t - S) - (/i2)2 

< 27^2 f \\Zis)\\e''^'-'^ds + ^Io [ 
Jo Jt 



ds — 



+ 00 



Z{s) 



(4.31) 



(1^2? 



\\Z{s)\\ds 



< Csfio—. + ^CsK, 

—p a — p 



\a-P\ 



ds 



^tmax{a,/3} ^ max{«,/3} 



(4.32) 
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which imphes 
0. 

From f OSjl . and let 
/ 



M{t) — Moo — (ast — )■ +00) exponentially since max{a, /3} < 



Moo,l 



p + QO 

J2 / Y,{s)Moc,ids 
i=i Jo 



V 



V / Yi{s)Moo.ids 
i=i "^0 



00,2 



Obviously, from f l4.29p and (14.311) . M^o is bounded. Thus 
/ 



\\M{t)-Mo 



Mn - Moo,i M12 - V / Fi(s)Moo,irfs 



M22 - Moo,2 



/•-l-oo 

r+00 



M{t) - M< 



From f lQg]) . f lCT]) . f lOT]) and f02]) . we obtain for any 5 G (ao,0) and 
a 7^ maxja, 



< 



^ /"+00 

M12 - J] / Y,{s)MooMs 
i=i Jo 

Vf /V^(s)l M,,(t-s)-M< 



(is 



< 

Therefore 



a — max{a,/3} ' |q;/3| 
26*4(^1 + P2) _^ C'3yUo(Pi + P2) 



\a — maxja, 



J, max{Q:,a,/3} 



\a — maxja, 
22 



max{a,a,/3} 



which imphes that M{t) approaches to M^q exponentially as t — i- +00. 

(ii). Now we assume /3o > 0. We only need to show that there is a special 
solution x{t] 0) such that the corresponding second moment is unbounded. 
Similar to the proof of Theorem 14. ![ let X = a + iu {a < ao < 0) be a solution 

'^1 \ ^ Tn>2 



of h{X) = 0, and c = \^ ^ J G is an eigenvector corresponding to the 

eigenvalue A, then Xfj,^{t) = Re(e'^*c) (t > —1) is a solution of (12 .Sp with initial 
function 02 = Re(e'*'*c) G C([— 1, 0], M^). Hence, for this particular initial 
function 02? since the assumption H is not satisfied, x^j^^lt) is not a solution 
of (11. ip and therefore -Pii(t) or P22(i) is nonzero. Thus the Laplacian C{Pii) 
or £(P22) is nonzero. 

Since \\M{t)\\ > ||M(t)|| > Mii(t), in the following, we only need to show 
that Mii(t) is unbounded for the initial function 02- From fl4.18l) . we have 

. ^^U. re- f^-t>fi<"''\ (P„)(.) 

2m T-^+oo J L 



H{s) 
His) 



CiP22)is) ds, 



where c > po- Here -^^ ttt^ — and \ are analytic tunc- 

H{s) H{s) 

tions for Re(s) > and are nonzeros. It is easy to see that £(Pii)(s), C{P22){s) 
are analytic for Re(s) = c > 0. Thus, similar to the proof of Theorem 12.11 
(3), there is a sequence {tk}k>i such that tk — >■ +00 and Muitk) — )■ +00 as 
A; — )■ +CX3, which implies that the second moment is unbounded. Thus, the 
theorem is proved. □ 

The critical case of ao < 0, /3o = is not considered here, and the issue 
of boundedness criteria remains open. 

The characteristic function H{X) depends not only on the coefficients 
of equation (14. ip . but also on the Laplace transforms of X^(t)Xj(t) and 
X!^{t)Xf{t — 1) k = 1, 2). One can calculate these functions numerically 



according to Lemma Appendix B.l and Appendix B.2, however, it is diffi- 
cult to obtain /3o = sup{Re(A) : H{X) = 0} for a given equation. Hence the 
sufficient conditions for the second moment boundedness of (14.11) established 
in Theorem 14.31 are not practical. In applications, one need to derive useful 
criteria in terms of equation coefficients, either from the proposed character- 
istic function or following the procedure in the above discussions. Here, for 
applications, we give a practical condition for the boundedness of the second 
moment. 
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Theorem 4.7. Assume < 0. If there exists a G (ao^ 0) and the a positive 
constant K = K{a) so that 

\\X{t)\\ < Re-"', t > 

and 

{Wl\ + H\ + Wl\ + + {Wl\ + + Wl\ + Ir^llY < ~„ (4.33) 
then the second moment M(t) is hounded. 

Proof. From the expression of Qii{t) and (13.191) . we obtain for i = 1,2, 
Quit) < {\al\ + \a^\){\al\ + + \a^\ + |r/,2|) [Mn(t) + 2|Mi2(t)| + M22(t)] 

1 + 1^- 1) + \vi\ + + m [Mu{t - 1) 

+2|Mi2(t- 1)1 + M22(t- 1)] 

= {wi\ + w-\){wi\ + \vi\ + w^\ + \vm\Mm 
+m + m + \vi\ + + \v^\) mt -m. 

Since Quit) > 0, for any a G (ao, 0) and i,j = 1, 2, 

\M,,it)\ < \F,,{t)\ + y^ f \X^{t-s)X^{t-s)Qkk{s)\ds 

< \F,,{t)\+a2K\^"' f e-^"'\\M{s)\\ds 

Jo 

+03X^6^"' [ e-2""||M(s- l)||rfs, 
Jo 



where 



«2 = {Wl\ + Wl\){Wl\ + \r^l\ + \al\ + \r^f\) 

+ (l^2l + k2l)(k2l + l^2l + l^2l + 

«3 = {\vl\ + \vl\){Wl\ + \vl\ + Wl\ + \vl\) 
+ H\ + \vl\){Wl\ + \vl\ + Wl\ + \4\). 



Thus from Lemma 13.51 we have 

2 _ .t 

||M(t)|| = V |M,,| < iri(l-e2"*)+4a2i^V"* / e-2"^||M(s)||cis 

+ 4a3i^'e2"* /" e-'"^||M(s- l)||rfs. 
Jo 
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Let 



y(t) = e-2"*l|M(t)|| 



r{t) = K^{e 



-2at 



1) 



and 



2a 



Then 




Choose A 



Jo Jo 

2a > 0, we get 



sup \r{t)e 
t>o 



-xt 



supis:i(l - e^"*) < 2Ki < +00. 



t>o 



By (14.331) . we obtain 

X-p- qe-^ = -2a - A{a2 + as)K^ > -2a + 4:K^-^ = 0. 

2K 

Therefore from Lemma 3.9 in j^, there exists C5 = 6*5(0;) such that 
||M(t)l|e-2"*=y(t)<C5e-2"*, t>0, 



In this paper, we have estabhshed framework procedure to calculate the 
characteristic function for the second moment boundedness of hnear delay 
differential equations with a single discrete delay, we also applied the proce- 
dure to study a special case of 2-dimensional equations. However, as we have 
seen, the resulting function has a very complicate form. These complicate re- 
sults is in fact show the elaborate correlations of non-Markov processes when 
both delay and stochastic effects are taken into involved. In spite of the 
complicate form of final formulations, the procedure of calculating is simple 
and easy to follow. Thus, in applications, one can develop the characteristic 
function, for particular equation of studied, following the scheme given here. 
We leave these further applications to future works. 

Appendix A. Proof of Theorem 12.11 (iii) 

Proof. Let ai < ao- Since the zeros of h{X) are isolated, we can take 
a G («i,ao) such that Re(A) = a does not contain any root of h{X) = 0. 
Next, choose Ci > ao and T > 0, then 



that is, \\M{t)\\ < C5 for all t > 0. 



□ 




(A.l) 
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To calculate the integral (lA.ip . we consider the integration of the matrix 
e'^*A^^(A) around the bounder of the box in the complex plane with boundary 
7 = 71727374 in the anticlockwise direction, where the segment 71 is the set 
{ci + ir : — T < r < T}, the segment 73 is the set {a + ir : —T < r < T}, 
the segment 72 is the set {u + iT : a < u < ci\ and the segment 74 is the set 
{u ~ iT : a < u < Ci}. Then Cauchy theorem of residues implies 

» m 

I e^'A-\X)dX = 27r? V Rese^*A-i(A) ^ 0, 

where Ai, A2, ■ ■ ■ , Xm are roots of h{X) = inside 7 (m > 1 from the definition 
of ao, and m < +00 since h{X) is an analytic function). We also assume that 



a < Re(Ai) < Re(A2) < ■ • • < Re(A, 



Note that 



Rese^*A"^(A) = Pj{t)e 



A=A 



where Pj{t) = (P/'(t))^^^ with P^\t) {k,l = 1, ■ ■ ■ , N) a polynomial of t 
with degree given by the multiplicity of Xj minus 1. Thus, 



„ m 

(h e^'A-\X)dX = 2mJ2Pjity^''- 



(A.2) 



From the definition of the adjoint matrix, we obtain 



e^*A-^(A)ciA 



72 



^^+'^ adj(A(A)) 



< e 



a+iT 
ci 



hiX) 



dX 



adj(A(M + iT)) 



(iw — > (as T — +cxd). 



h{u + iT) 

where adj(A(A)) is the adjoint matrix of A (A). In the same way, we have 



j e^'A-\X)dX 
J 74 



^ (as T ^ +00). 



Therefore by (I A. 2 1) we get 



lim 

27ri 



ci+iT 



e^'A-\X)dX+ 



ci-iT 



lim 
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a-iT 
a+iT 



e^'A-\X)dX = J]Pi(t)e 



Xit 



I.e., 



X(t)=X^(t) + 5^P,(t)e 



where 



1 pa+iT 

X,(t) = — lim / e''A-\X)dX^{X'J{t)) 



NxN ■ 



Moreover, similar to the proof of Theorem 12.11 (i) (refer j8| or [17|), there 
exists a positive constant C = C{a) such that Xa{t) satisfies 

<C'e'^*, t>0. 



Thus we obtain for and k,l = 1, ■ ■ ■ , N 



\xi{t)\ > 



X'^\t)\ > 



-Ce 



at 



(e(^"(^i)-°)*/(i) - C) 



where fit) = Y,%^pki{t)e'^^3-^<\i))t . 

Let Xj = (3j + iuj (j = 1, 2, ■ ■ ■ , m), and assume uq such that (3j < f3„ 
when 1 < j < "^0 and Pj = Pm when uq + 1 < j < m. Then 



fit) 



3(/3m-/3i)t 



no 



j=jlo + l 



> 



^ Re (Pf (t)e^"'^*) 

i=no+l 



no 



^g-(/3m-/3,)t |Pj''(t)| . 



Since Pj (t) (j = 1, 2, ■ ■ ■ , m) are nonzero polynomials, we find that 



J2 Re (Pf (t)e''"^*) = f 



ni 



ttj cos(c(;jt) + 6j sin(a;jt) + 0{t 

J=no+l 



-1\ 



J2 ^a] + b]sm{ej+uj,t) + 0{t-') 

j=no+l 
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(ast — )■ +00), where aj, bj {j = Uq + I, ■ ■ ■ , m) are constants and a'j + b'^ 7^ 0, 
rii is the highest degree of the polynomials P^\t) {j = uq + 1, ■ ■ ■ ,m), and 



sm 



a.+bj 



Thus, we can always find a subset Uq C with measure m{Uo) = +00 such 
that all functions 



sm 



oojt) > e, t eUo, no + 1 < j < 



m 



for some small positive constant e, and therefore the subset U is always 
possible by taking U = Uof](tQ, +00) with large enough. Hence for the 
above e and Wt G f/, 



J2 Re (Pf (t)e'"^*) 

j=no+l 



> 2e. 



Furthermore, since 

Ej=i e-^^™-^^)* l^f (^)| ^ as t ^ +00, we can take U 

such that 

g(Re(Ai)-a)ty.^^^ - C > 1, Vt G t/ 



and hence for any k, I 



N andte U, 



\Xi{t)\ > e^* (e(^'=(^i)-")*/(t) - C) > e"^*. 



therefore (12.91) is concluded. 



□ 
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Appendix B. Expressions and estimates of the Laplace transforms 
C (x'=(t)X^(t)) and C {x^{t)X^{t - 1)) 

Lemma Appendix B.l. Assume ao < 0. For any Re(A) > ao (-^ ^ C), 



1 /■+°° iiij — n'^ — h^p"^ \ — ill] — n'^ — h''p^^^~^'^> 
1^^^^ 2nJ_^ h{iuj) h{\-iu) 

+ ^?ii(A), (B.l) 



- MA -co) ^^-'^ 

£((X2^)2)(A) = — / . «2+^2e ^ 

^' ' 2n h{iu) h{X-iu) 



a 



,1 

2 "T "^2 



+ ^21 (A), (B.3) 



h{X — do) 

A(^2))(A) = ^^-^ ^^3^3-^ rfu; 



+ ^22(A), (B.4) 



h{\ — ckq) 

£(x.%')(A) = ^£ -.,7 ^ 

Ip-(A-ao) 

+ ^31 (A), (B.5) 



27r /i(ia') /i(A — iu) 

/i(A — ao) 

c{x,x,){x) - -y_^ h(x:r—) ^ 

„2 , l2 -(A-Qo) 



29 



where 



iic - ii-, - hit 
9ii(A) = ^/ ^—f X 



h (iui) 



-(a| + a + «o)(-^ — i^) — b + aoa| — [(c + b2){X — iuj) — ciQb% + d] e 



912(A) = ^j_ 



h(X — ioj) (X — ioj — ao) 



■X 



h (iio) 

— (A — ioj)^ + (of — a)(A — ioj) — b — aoal — [(c — 6i)(A — ico) + aoft? + ci] e~ . „ ^ 

ft (A — iLo) (X — iu! — ao) ' 



922(A) = ^ I 



ft. (ioj) 

a) (A — iui) — b — 

ft (A — io)) (X — iuj — ao) 

ioj-al -b[e-^" 



-(A - io))^ + (g^ - a)(A - ia;) - b - apa^ - [(c - b^)(A - ic^) + gpft^ + (i] e't^"'^") - r-g-^^^-'") 



- X 



ft {iui) 

(a} + g + a(i)(A - io;) - fe + apq^ - [(c + bl)(A - ia>) - ao&i + d] g-'^-'") ■ . ^ 

ft (A — iai) (A — iai — ao) ' 



^3i(A) = ip/ - 

J — oo 



1 I 1,1 „ — ioj 



2 ^ "2 



e 



-X 



ft (joj) 

-(gj + g + ao)(A -iw)-b + aoal - [(c + bl){X - iui) - aob| + d] e-(^-'") - re-^<^-'"> ^ 

ft (A — iw) {X — iu! — ao) ' 

932(A) = 2^ / ■ , , X 

-(gj + g + ao)(A - iui) - b + aoaj - [(c + fel)(A - iui) - apbl + d] e'^^''"^ - re'^^^-''^) ^ 

ft (A — iai) (A — iai — ao) 

Furthermore, there exist positive constants Cij {i — 1,2,3, j — 1,2) and 
Rij {hj — 1) 2) such that for Re(A) > ckq, 

lim |(7,,(A)|=0(^ = l,2,3,j = l,2), 

|A|-i-+oo 

lim |A5fi2(A)| = ci2, lim \h{\ - ao) gii{\)\ = cu {i = 1,2), m 

|A|-i-+oo |A|->+oo V -'J 

lim \Xg2i{X)\ = C21, lim \h{X - ao)g3j{X)\ = Csj {j = 1, 2) 

|A|->-+C!0 |A|-^+cc 



and 



lim |A£((X/f)(A)|=i?,,(i,j = l,2), 
lim |A£(X,%^)(A)|=0, lim |A£(X,%^)(A)| = 0. ^^"^^ 

|A|— >-+oo |A|— >+oo 
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Proof. For any Re(A) > 2ao (A G C), 



r+oo 1 
Jo J-oo 



h{iuj) 



1 
1 

2^ 



h{iuj) 



Since e-^^-'^-^^^'dt 



1 



A — — ao 



for Re(A) > ao, then 



doj. 



c-{{xiY){x) 



2^ 



h{iuj) 



\ — ico — ao 



-du 



+ 



2tt 



2 1.2 -iuj 
lU — a2 — 



h{iuj) 



\-iuj-al- 62e-(^-^'^) 



27r 

+ 00 



/i(A — iuj) X — iuj — ao 

e''^^dujdt + gn{\) 



-i^-^o)txl(^t)dt + gniX) 



\-ao-a^- 62g-(A-a„) 



for Re (A) > ao, where 



1 r°° iuj - ai - bie- 
9iiW = ^ / TT-^^ X 

-(a^ + a + ao)(A - iw) - 6 + ^002 " [(c + 62)(^ " " "0^2 + e^^^-^") - J,^-2{X-^u>) 

ft, (A — iw) (A — — ao) 

Note that 5'ii(A) is convergent for any Re(A) > ao- Hence there exist two 
positive constants Cn and -Rn such that when Re(A) > ao, 

hm |(7n(A)| = 0, hm \h{X-ao)gu{X)\ = Cu, hm \XCi{Xlf){X)\ = Rn- 

A|— i>+oo |A|— i>+oo |A|— >-+oo 



duj. 



Other expressions in (]B.ip - (]B.6p . ( IB .TP and ( IB.SP can be obtained similarly. 



□ 



Similar to Lemma Appendix B.l we have the following expressions and 
estimates. 
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Lemma Appendix B.2. Assume ao < 0. For any Re(A) > ccq (A e C), 

aX^(t)X^(t 1))(X) - ' e-'-{iu;-4-ble-^-) A - io; - - 6^e-(^-^-) 
£(X,(t)X,(t-l))(A) - ^^^-^ ^^^^^--^ du; 



+ 5ii(A), 



£(Xf(i)X^(t-l))(A) = ^l^T ■ ^V^^ ■ ^ ^ 

g-(A-ao)(^2^^2g-(A-ao)) ^ 

= HX^) + 

= MA^^^^ 

c{x,{t)x,it-mx) - h(x^) 

e-(A-ao)^_^^_al_5le-(A-.o)^ 

= HX-ao) 

C(X^(t)XHt mX) - ' e-^-{al + ble-^-) A - ^a; - - 6^e-(^-) 

c{x,{t)x,{t-mx) - h(x^) 

e-(A-ao)(4 + fcie-(>-«°)) „ 

= TTT ^ \-93l[X), 

n(X — aa) 
e-(A-ao) (A-ao-a^-62e-(^-"«)) 



/i(A - ao) 



+ 532(A), 



aX-(t)X^(t mX) - ' e-^"(^a;-a^-6^e-^") gf + 6^e-(^-) 

£(Xi(i)X2(t-i))(A) - ^^^-^ 



CiXl{t)XUt-mX) = 



/i(A — ao) 



ft.(iw) h{X — iuj) 

e-(A-ao)(Q2^52g-(A-ao)) 



341(A), 

o-(A-iw) 



/i(A - ao) 



+ 542 (A), 



32 



where 



911 



TOO p. [lui — 02 — J 

h (iu)) 



(gj + g + Qo)(A - iuj) -b + apa^ - [jc + fc^)(A - ii^) - apbl + d] e'^^"'") - re'^t^"'") ^ 

(A — io)) (A — io) — ao) ' 



912(A) = ^ |_ 

- io))^ + (gf — g)(A — ioj) — b - 

h{X — iui) {X — iui — ao) 



h (iui) 

(A - iojf + (gf - g)(A - ioj) - b - gggf - [(c - 6j)(A - + Qpfof + d] e-(^-'") - re'^^^-'") 



a2l(A) = 5^ / —r— 



h {iu}) 

-(A - iujf + (g^ - g)(A -iw)-b- aoa\ - [{c - bl){\ - iui) + apbl + d] e-<^-'") - re-'^i^'"'^) ^ 

h{X — iui) {X — iui — ao) ' 

922 A = ^ / ^ \ X 

-{a\ + g + ao)(A -~iuj)-b + aoa\ - [(c + b\)(X - iuj) - apbl + d] e-<^-'") - re'^^^-^") ^ 

ft. (A — iai) (A — io) — ao) ' 

931 A ^f— ? 

'^^ J-oo h{iui) 

-(gj + g + ao)(A - iu;) - 6 + aoaj - [(c + fei)(A - iui) - apbl + d] e~(^~'") - re~^<^~'") ^ 

h(X — iui) (X — iui — ao) ' 



{ioJ -al- ble-"^) 

h(X — iui) (X — iui — ao) 



1 f'^°° 

932(A) = / , ,. , 

-(A - luj)'^ + (g^ - g)(A - iui) - b - apal - [(c - fc^)(A - iui) + gpfe^ + d] e'^^-'") - re'^^^-'") 



r+°° e-^" (iw - g} - bje"'") 



941(A) = ^ |_ 

- io))^ + (gf — g)(A — iuj) — b - 

h{X — iui) {X — iui — ap) 



h{iui) 

(A - iui)'^ + {al - g)(A - iu;) - 6 - apal - [jc - fcf )(A - iui) + gpfef + d] g-^^"'") - re"^^^"'") 



g,,iX) = ^l_^ h(^) " 



/i (A — ioj) {X — iui — ap) 

Moreover, there exist positive constantscij {i = 1,2,3,4, j = 1,2) such thatfor'Re{X) > ao 



lim |5i,(A)| =0(i = 1,2,3, 4,i = 1,2), (B.9) 

|A|->-+oo 



and when i = 1,3 



when i = 2,4, 



lim \h{X - ao)gii{X)\ = ca, lim |As'i2(A)| = Cj2, 

|A|->+cx> |A|->-+(x) 



lim \h{X - ao)gi2{X)\ = Ci2, lim \Xgii{X)\ = cu. (B.IO) 

|A|->-+oo |A|->+cx> 
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Appendix C. Proof of Lemma 14.51 
Proof. Assume ao < 0. Let 

Z{t) = (;^adj(/ - D{X))A{X)^ ^ (%(t))2x2. 

We only prove that there exists a positive constant Ku such that for any 
(3 > max{ao, /3o}, 

|^ii(t)|<i^iie^*, t>0. 

The estimates of Zi2{t), Zii{t) {i = 1,2) are similar and omitted. 
Let 

du{X) du{X) 



D{X) 



4i(A) d22{X) 



then 



(c.i) 



H{\) j V il{X) 

Now, we estimate the two terms in ( IC.ll) respectively. 
When /3 > /3o, + iw) ^ for any w G M. Thus 

, ( {\-d22)L{{X\f) \ _ f (1 - d22)C{{Xiy) , 

_ 1 r^-^.(i-^22)/:((x,Y) 



2vrz T^+oo H{X) 
where C2 > /3 is large enough. First we want to prove that 



-1\2\ 



To this end, we consider the integration of the function e'^*-^^^ — ^^rrf'S!''^^' 

H{X) 

around the boundary of the box F in the complex plan with the boundary 
F1F2F3F4 in the anticlockwise direction, where the segment Fi is the set 
{c2 + ir : — T < r < T}, the segment F2 is the set {u + iT : (3 < u < C2}, the 
segment F3 is the set {(3 + ir : — T < r <T} and the segment F4 is the set 
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{u — iT : (5 < u < C2}. Since H{X) has no zeros in this box F, the integral 
over the boundary is zero, i.e., 



ri JV2 JTa JT^ 



Thus, flC.2l) is concluded if 

{l-d,,)C{{Xlf] 



lim 

T-i.+oo 



.At' 



H{\) 



H{\) 



dX = (i = 2,4). 



Since H{X) = (1 — du){l — ^22) — rfi2'^2i, we have 

H{X) di2d2i 
- J- — "11 



1-d 



22 



1 - (^22 ' 



From Lemma 1131 there exits a constant Ti > Tq > such that when |A| > Ti 
and Re(A) > do, 



dl 



H{\) 



1 - rf. 



22 



^ . I , I M12IM21I ^ ^ do \\\' 1 



Hence from ([El]), for |A| > Ti and Re(A) > ao, l-^^ll^i^)^) < and 
therefore 



^,, Xi-d,,)c{{xlf) ^^^ 



T2 



H{\) 



(1 - d,,)C{{Xlf] 



C2+iT 

H(X) 



dX 



< 2 I e ^ 

< ^^^^^^y^(c2-/3)->0(asr^+oo) 



Similarly, 



(1 - d22)mxi 



1\2\ 



e^*rfA ^ (as T ^ +00) 



HiX) 

Thus, ( 1C.2I) is obtained. 
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Let Ti as above, and 

(1 - d,,)c{{xir) 



W{X) 



1 



^(A) A - /3o 

1\2\ ^ ~ f^O - 



H{X) 



(1 - d22)C{{Xl 



(1 - d22)C{{Xl 



1\2\ 



H{X) \-(3o 
From Lemma Appendix B.l[ we have for Re(A) > ao, 

H{\) 



A-/3o 
A 



(1 - d,,)C{{Xlf) 



-/3o- 



C{{Xlf] 
1 



C{{X[ 



l\2\ 



C{{Xlf 
H{X) 



H{X) 



1 - rf. 



22 



1 - 



- 1 



22 



(ao — a — al)\ + ao*^ — b — h{X — ao)*?!! 
A - ao - ^2 - &2e"^^"°"^ + h{X - ao)^ii 



(6^A + c(A - ao) + d) e^^^^"") + re'^^^-^^) 
A - ao - ^2 - ble-^^-'^"^ + /i(A - ao)^ii 



and 



mxi 



1\2\ 



HiX) 



1 - d 



22 



h{X — cto) 



A - ao - ^2 - bje-^^-""'^ + h{X - ao)gii 
di2d2i 



X 



11 



1 - d 



22 



From (14 .20 p . there exists a positive constant rn such that for |A| > Ti and 
Re(A) > QiQ, 



C{{X[ 



l\2\ 



H{X) 



1-d 



- 1 



22 



< ni 



and 

A-/3o 



H{X) 



(1 - d,,)c{{xir 

which, applying ( IB.Sp . imphes 

\W{X)\ < 



< \ao-a-al\ + \l3o\+ru = |ao + ai| + |/3o| +^"11, 



ao + a} 


+ |/3o 


l+Fii 2(l + i?n) ^ 2(l + i?n) (|ao + aJ| 


+ |/9o 


+ rii) 


|A 


-/3o| 


|A 


|A||A-/3c 
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Thus, for (3 > max{ao, /3o}, since A — /3o 7^ and H{\) ^ (Re(A) > /3| 



_,/(!- MAW 



\\2\ 



H{X) 



H{X) 



[ e^'Wi\)d\+ [ 

J(3) J(L 



[13) ^ — 



-d\ 



e^'W{X)dX 



+ 2 



i^Tiie^*, t > 0, 

2(l + i?n) {\ao + al\ + \(3o\ + ni) 



Ti 



Ti 



Ti 



\W{f3 + lT)\dT 

2{1 + Rn) {\ao + a\\ + |/3o| 



dr 



where 



Ti 



Ku = 1+ / \W{^ + iT)\dT + 2 



+00 



dr. 



Ti 



Now, we consider the second term in (IC.ip . Since 
HiX) (1 - dn){l - d22] 



duiX) 



d 



d^ 



21, 



12 



from Lemma HiH there exits a constant T2 > Tq > such that when |A| > T2 
and Re(A) > ao, 



H{\) 



Arfi2(A) 



> 



(1-Mn|)(l-M22|) 



|A| L \d 



\d 



21 



12 



> ^ |Ar^ |A|^ rfo ^ 1 
4 |Ap - 24' 

Thus for |A| > T2, Re(A) > ao and z = 2,4, from flRSjl . 



.At 



rfi2i:((x 

HiX) 



1\2\ 



-dX 



< 



< 



C2 



u.2doil + R2.)^^ 



2e^^*rfo(l + R21 
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(C2 - /3) ^ (as T ^ +00). 



Hence 



H{\) 



^ H{\) 



Therefore, from (IB.SI) . we obtain for /3 > max{ao, /So}, 



1^2^ 



HiX) 



< e 



T2 



-T2 



l\2\ 



+ ir) 



dT + 2 



T2 



2rfo(i + i?2i; 



■dr 



= Kiie^\ t>0, 



where 



Ku 



T2 



T2 



di2C{{Xlf) 



H{/3 + iT) 



dT + 2 



+00 



T2 



2rfo(l + R21] 



dr. 



Taking Ku = Ku + Ku, (IC.ip is concluded and the Lemma is proved. □ 
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